Estimating the Precision of the Likelihood-Ratio Output of a Forensic-Voice-Comparison System
نویسندگان
چکیده
The issues of validity and reliability are important in forensic science. Within the likelihood-ratio framework for the evaluation of forensic evidence, the log-likelihood-ratio cost (Cllr) has been applied as an appropriate metric for evaluating the accuracy of the output of a forensic-voice-comparison system, but there has been little research on developing a quantitative metric of precision. The present paper describes two procedures for estimating the precision of the output of a forensic-comparison system, a non-parametric estimate and a parametric estimate of its 95% credible interval. The procedures are applied to estimate the precision of a basic automatic forensic-voice-comparison system presented with different amounts of questioned-speaker data. The importance of considering precision is discussed.
منابع مشابه
Traditional Forensic Voice Comparison with Female Formants: Gaussian mixture model and multivariate likelihood ratio analyses
The first likelihood ratio-based forensic voice comparison on female voices, and the first forensic use of Gaussian mixture models on traditional features, are described. A GMM-UBM LR-based comparison is performed on the first three formants of the five long /monophthongs/ of 20 General Australian English female speakers in non-contemporaneous recordings separated by one to five weeks. Comparis...
متن کاملA Comparative Study of Two Procedures for Calculating Likelihood Ratio in Forensic Text Comparison: Multivariate Kernel Density vs. Gaussian Mixture Model-Universal Background Model
We compared the performances of two procedures for calculating the likelihood ratio (LR) on the same set of text data. The first procedure was a multivariate kernel density (MVKD) procedure which has been successfully applied to various types of forensic evidence, including glass fragments, handwriting, fingerprint, voice, and texts. The second procedure was a Gaussian mixture model – universal...
متن کاملWhat is the Relevant Population? Considerations for the Computation of Likelihood Ratios in Forensic Voice Comparison
In forensic voice comparison, it is essential to consider not only the similarity between samples, but also the typicality of the evidence in the relevant population. This is explicit within the likelihood ratio (LR) framework. A significant issue, however, is the definition of the relevant population. This paper explores the complexity of population selection for voice evidence. We evaluate th...
متن کاملThe Place of Forensic Voice Comparison in the Ongoing Paradigm Shift
We are in the midst of what Saks & Koehler (2005) have called a paradigm shift in the evaluation of evidence in the forensic comparison sciences. This is a shift to requiring that the evaluation of forensic evidence actually be scientific, including that the reliability of methodologies be testable, and requiring that forensic evidence be evaluated and presented to the courts in a logically cor...
متن کاملReplicate Mismatch between Test and Background/Development Databases: The Effect on the Performance of Likelihood Ratio-based Forensic Voice Comparison
This study reports the extent that mismatch in within-speaker replicate numbers between test and background/development databases causes an influence on the performance of a forensic voice comparison (FVC) system. FVC tests are repeatedly carried out using the Monte Carlo simulation technique with temporal MFCC features and the Multivariate Kernel Density Likelihood Ratio Procedure. The perform...
متن کامل